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Abstract: We demonstrate how interactive, three-dimensional (3-d) scientific visualizations can be 
efficiently interchanged between a variety of mediums. Through the use of an appropriate interchange 
format, and a unified interaction interface, we minimize the effort to produce visualizations appropriate 
for undertaking knowledge discovery at the astronomer's desktop, as part of conference presentations, 
in digital publications or as Web content. We use examples from cosmological visualization to ad- 
dress some of the issues of interchange, and to describe our approach to adapting s2plot desktop 
visualizations to the Web. 
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Keywords: cosmology: miscellaneous — methods: data analysis — techniques: miscellaneous 



1 Introduction 

There are four main ways that astronomers (and sci- 
entists in other disciplines) use visual representations 
of datasets: 

1. For knowledge discovery; 

2. For formal publication of research results; 

3. For academic presentations; and 

4. For (formal) education and (informal) public out- 
reach. 

One of the challenges of developing effective visu- 
alizations appropriate for all of these targets is the in- 
creasingly multi-dimensional nature of astronomy data. 
Consider the wealth of information offered by four- 
dimensional radio data cubes of neutral hydrogen clouds 
(RA, Dec, velocity and intensity); seven-dimensional 
cosmological simulation outputs (three-dimensional po- 
sitions and velocities, particl e mass); or the 77-dime nsional 
Hipparcos Main Catalogue (|Perrvman et al.lllQOTT ). 

A wide range of software packages, including cus- 
tom codes and commercial solutions, are available for 
the steps of processing, analyzing and visualizing multi- 
dimensional astronomy data. However, despite the 
wealth of tools and techniques, most of astronomy is 
still performed, presented, taught and learnt in only 
two dimensions. Aside from the obvious explanation 
that producing and displaying two-dimensional (2-d) 
images from scientifi c datasets is relatively st raightfor- 
ward (see item 14 in lGlobus fc Raiblell 19941 ). another 
factor is relevant: 2-d plots and figures produced for 
one medium (eg. paper) are easily transferable to an- 
other medium (eg. screen). That is, they are easy to 
interchange. A cartesian scatter plot can be sketched 
on a whiteboard, drawn accurately on-screen for anal- 
ysis, be saved in suitable format (s) for presentation in 
a lecture or conference talk, and for publication in a 
printed journal. The audience "uses" the 2-d plot in 



the same way, regardless of the medium via which it is 
delivered. 

If we extend the visual dimensionality from two to 
three, no such simple interchange mechanism exists. 
The visualization tool used by the researcher on the 
desktop is typically not the same one that is used to 
make a conference presentation, and the creation of 
educational versions of datasets is usually achieved by 
handing the data to an animator to interpret using a 
commercial animation package. At each stage, data 
is converted for use from one tool to another, each 
step taking it further away from the original desktop 
experience, and requiring significant additional effort 
for the astronomer. Furthermore, there is no common 
user interface — a fully interactive desktop applica- 
tion is most often reduced to a series of still images. 
What hope, then, for more complex, multi-dimensional 
datasets? 

We have previously reported on the s2plot inter- 
active graphics library for creating three-d imensional 
(3-d) visualizations for knowledge discovery ([Barnes et al. I 
[2006), and demonstrated the novel capability to pro- 
duce interactive 3-d figures in the Adobe Portable Doc- 
ument Fbmm^_(PDF}toenhance academi c publica- 

tions ([Barnes fc Fluke l2008l ) and education ([Fluke fc Barnes I 
120081 '). We now describe solutions for interchanging 
3-d figures amongst the remaining output targets, as 
shown in Figure [1] Specifically: 

• Desktop visualization is accomplished with an 
application (C, C-|— 1-, FORTRAN, Python; mys2program 
in Figured} that uses the s2plot hbrary. With 

a programming interface similiar to the popular 
PGPLOT 2-d libraryQ s2plot provides a straight- 
forward way for astronomers to produce 3-d plots 
on-screen through simple function calls within 
their own custom codes. 

• 3-d figures are embedded in PDF files by ex- 
^ ,http : //www.astro. caltec .edu/^t jp/pgplot| 
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Integrated presentation with embedded S2PL0T visualization/s 

s2slides 



Standalone desktop visualization with 
S2PL0T application program 

my s2program 

S2PL0T software library 

libs2plot . * 



VRIUIL export facility 

Shift-W writeVRML20 



[ required ] 
s2slides description file 

myslides . s21 



[ optional ] 
prepared slide image files 

* .tga 



[ optional ] 
additional S2PL0T program/s 



User interface 

s2plot . j s 



Adobe Acrobat 3D 
software 




VRIUIL output file 

my3d.wri ,-' 

Textures , 

\ * .tga /' 



Vrml97ToX3dNist software 
Zip archiving software 




Portable visualization with Adobe 
Acrobat Reader 8.x 



Online (web-based) visualization with 
Adobe Flash-enabled web browser 



S2PL0T Flash player 


s2web 




PaperVisionSD 






s2web ActionScript 3 code 









Web page with embedded s2web 
application and data parameter 
giving s2web archive file location 



Figure 1: An integrated system for creating, interchanging and using interactive 3-d figures in astronomy, 
based on the s2plot hbrary. The large upper box encapsulates desktop visualization and s2slides 
presentation modes, while the lower part of the figure shows the components concerned with production 
of 3-d PDF and web-based visualizations. Shaded triangles indicate primary output products, and the 
dashed triangle indicates the (transient) interchange step: the VRML output file and textures do not 
need to be retained once the primary output product/s are created. Adobe Acrobat 3D is a commercial 
product. 
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porting the s2plot program geometry to VRML 
(Virtual Reality Modeling Language; keypress 
Shift-W or function call writeVRML20() in stan- 
dard s2plot programs), then importing the VRML 
to Adobe Acrobat 9 Pro Extended, Adobe Ac- 
robat 3D or the Adobe 3D Toolkit (commer- 
cial software). The standard s2plot interaction 
mode (as well as support for volume rendering, 
billboards and so on) is implemented in the pro- 
vided s2plot. js script, which can be added to 
the 3-d PDF model. The exported VRML file 
is an interchange file only; it need not be kept 
after the PDF file is created. 

• PowerPoint-style presentation is enabled by the 
S2SLIDES application included with s2plot: it 
provides for navigation through a sequence of 
pre-rendered slides (* .tga file/s in Figure[T] e.g. 
bitmap images exported from Microsoft Power- 
Point), and can overlay standalone interactive 
s2plot programs on slides according to simple 
instructions in an input text file (myslides . s21 
file in Figure [T|. Note that s2slides does not 
require Microsoft PowerPoint or any other com- 
mercial presentation software, although such soft- 
ware may be a convenient way to generate non- 
interactive slides for presentation with s2slides. 

• 3-d figures are deployed on the Web by exporting 
to VRML, as for the PDF case, converting the 
VRML to X3D (a simple, syntax-only conver- 
sion accomplished with VrmlToX3dNist). This 
X3D is then zipped up with the required tex- 
tures. The resultant archive (an "s2web archive 
file") can then be provided to the s2web pro- 
gram, which is an Adobe Flash (hereafter "Flash" ) 
program that renders s2PLOT-originated X3D con- 
tent. s2wEB allows the user to control the cam- 
era and rendering properties just as they do for 
desktop s2plot programs. 

A key feature of our approach to interchange is the 
preservation of the user experience, particularly via 
the keyboard and mouse controls for interaction, data 
selection and control of the visual appearance (such as 
rendering mode). 

This paper is organized as follows. In section 2, 
we discuss our choice of Web technologies for integra- 
tion with s2plot . We detail the practical application 
of these technologies that enable s2plot programs to 
produce 3-d visualizations for multimedia deployment. 
We further explore the motivation for, and implemen- 
tation of, a common user interface across the output 
targets for s2plot programs. In Section 3, we consider 
the specfic case of cosmological data as motivation for 
the demands and requirements of interchanging 3-d 
data and models, and present several applications en- 
abled by our approach in Section 4. A brief discussion 
of our future plans follows in Section 5, and we make 
some concluding remarks in Section 6. 

2 Interchange 

Astronomers have been willing users of Web technolo- 
gies, most significantly in the way that they commu- 



nicate and collaborate across the world. Astronomers 
have also taken to fully online, digital publication of re- 
search papers and data archives. Of particular impor- 
tance were the first online edition of t he Astrophy sical 
Journal published in September 1995 (|Abt 1120031 "). the 
abstract searching capabilities of the ADS Abstract 
Service (|Murrav et al. Ill992l : iKurtz et al. 200 0|), the 
widespread availablity of scanned articles (Eichhorn et al. ] 
Il994l \ and the establishment of the Centre de Don- 
nees astronomiques de Strasbourg (CDS) online data 
archives (Gcriova ct al. 19 961), the prec ursor to the 
Virtual Observatory ijQuinn et al. I [20041 ). Amongst 
the physical sciences, astronomers are second only to 
the particle physics community as users and drivers of 
Internet technologies. 

The present problem we are addressing is the pro- 
vision of a pathway for publishing and sharing inter- 
active 3-d datasets on the Web. Accordingly, our ap- 
proach is to develop and implement the necessary (in- 
formal) standards that yield a practical mechanism for 
the creation, interchange and use of interactive 3-d fig- 
ures. 

2.1 Exporting s2plot Geometry 

Simple and robust standardized 3-d interchange for- 
mats have been available for quite some time, notably 
ISO/IEC 14772:1997 Virtual Reality Modeling Language 
(VRML) and its successor ISO/IEC 19775:2004 Ex- 
tensible 3p (X3D). When imple menting our 3-d PDF 
solution (|Barnes fc Fluke II2008D . it was necessary to 
choose an interchange format for exporting 3-d geom- 
etry from s2plot programs. We selected VRML be- 
cause it is one of the few open, non-proprietary file for- 
mats that Adobe Acrobat 3D can import. Programs 
using versions 2.0 and upwards of the s2plot library 
can now write the s2plot geometry data to a VRML 
file that can be imported into Acrobat 3D for the cre- 
ation of 3-d annotations in PDF documents. 

It is worth making the distinction between our use 
of VRML a nd earlier uses of VRML for astronomy vi- 
sualization llCrutcher et al. 11199^ : iPlante et all 1 19991 : 
iBeeson et aL Il2004^ . In previous systems, VRML was 
the final product: it had to be viewed in a VRML 
browser such as Cortona or FreeWRL. Historically VRML 
browsers have not been particularly complete (in terms 
of implementation of the entire language), fully cross- 
platform or especially stable. Nor have their user inter- 
faces been adaptable to suit users' expectations. Our 
use of VRML is as an interchange format: it is simply 
an intermediate format for expressing s2plot geom- 
etry for onward conversion and/or import into other 
software. 

The scene geometry in VRML is structured as a 
model tree — a concept common to many 3-d appli- 
cations and scene description formats. The tree allows 
related components of the geometry to be grouped in 
a "branch". This tree is preserved upon VRML im- 
port to Acrobat 3D, and Adobe Reader provides both 
an application programming interface (API; via Adobe 
3D JavaScript) and a simple user interface for switch- 
ing parts of the model tree on and off. For our 3-d 
PDF solution, we added a function to s2plot that 
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allows the user to arrange the geometry into a tree 
when exporting VRML. Selective use of this function 
(pushVRMLname) makes it possible, for example, to ex- 
port two or more different visualizations of the same 
data from one s2plot program into one VRML file (we 
demonstrate an example of this in Section I4.3|l . Im- 
porting this VRML file to Acrobat 3D together with 
some very basic JavaScript code enables reader con- 
trol of the visualization state via buttons or other user 
interface elements in the target PDF file. 

2.2 Web Deployment with Flash 

Flash applications are ubiquitous on the Web, which, 
together with the breadth and depth of the Action- 
Script 3 API, makes Flash the ideal system for the 
development of a Web-based "player" of s2plot con- 
tent. Unlike Java — the only other viable environment 
for Web-based 3-d at this point in time — Flash appli- 
cations run in-browser, integrate seamlessly with static 
Web content, and the necessary plugin(s) are generally 
kept up-to-date. Ideally for the academic community, 
Flash applications can be developed with the freely- 
available Adobe Flex 3 SDK. 

Writing a complete 3-d engine for Flash would be 
a formidable task. Happily there already exists a ma- 
turing, open-source project implementing a 3-d envi- 
ronment in Flash: Papervision3D0 Papervision3D is a 
software 3-d API for Flash, distributed under the MIT 
license. It provides a high-level 3-d engine capable of 
displaying a standard set of 3-d primitives, mapping a 
variety of textures onto objects, including image and 
movie textures, and navigating and manipulating 3-d 
space. Papervision3D objects can be defined in Ac- 
tionScript 3 code or can be read from external files 
which contain the geometry information. 

Papervision3D allows camera and environment re- 
definition such that we were able to port the code con- 
trolling the s2plot interface to ActionScript 3, giv- 
ing a very closely matched interface to the one pre- 
sented by native s2plot desktop applications. Paper- 
vision3D even allows for object interaction, so that the 
s2plot interactive "handles" can be made available 
within Flash applications. 

Our Web-based solution for 3-d export from s2plot 
entails a simple, syntactic translation of the exported 
VRML to X3D. This translation retains the model tree 
structure, and consequently our Flash s2wEB program 
can also provide explicit or implicit user-control of the 
model tree and visualization as has been accomplished 
for PDF. 

Predefined strings within the model tree are used 
to denote s2plot "handles" (which are selectable el- 
ements of scene geometry) and "billboards" (textured 
rectangles which always face the camera), and to sup- 
port volume rendering. Using predefined (or "special") 
strings for pushVRMLname makes downstream Action- 
Script 3 or JavaScript code umversal; e.g. one Adobe 
3D JavaScript code for rotating billboards correctly 
will work for all s2plot VRML output containing bill- 
boards. 

^PapervisionSD: |http : //blog . p apervislonSd ■ org | 



X3D was chosen as the most appropriate inter- 
change format for the following reasons: 

• For the set of features requiring support, X3D is 
equivalent to VRML 2.0, easily convertible from 
VRML, and s2plot was already capable of out- 
putting VRML. 

• XML-encoded X3D is very simple to read and 
parse in Flash; ActionScript 3 has XML pars- 
ing as a native part of the language, and the 
XML Document Object Model (DOM) struc- 
ture is mirrored by the ActionScript 3 objects 
created. This is particularly useful for parsing 
the hierarchical geometry model tree, and maps 
isomorphically to the Papervision3D geometry 
tree. 

• Although text-based X3D documents are larger 
than the equivalent geometry expressed in a bi- 
nary format. Flash can easily read zipped files. 
A zipped archive can also contain the neces- 
sary textures for a scene, so an entire 3-d scene 
can be exchanged in a single file (this is much 
like Google Earth's KMZ files, which are zipped 
archives of CoUada files with textures). 

Our final Web-deployment platform is therefore 
a Flash Papervision3D application, capable of read- 
ing XML-encoded X3D converted output from s2plot 
programs, and providing a very similar user interface 
to s2plot. This enables two types of applications: 
a Flash X3D static geometry-viewer (like the native 
s2plot program s2viEw), and custom s2plot Flash 
applications. The viewer has the advantage that it 
can display any supported static geometry output by 
s2plot, without having to write any ActionScript 3 
code (an unfamiliar language to most astronomers). 
Nevertheless, the s2plot layer we have built on top 
of Papervision3D is simple enough that scenes can be 
animated just by editing a short callback, in the same 
manner in which geometry is made dynamic in the 
s2plot library. 

3 Cosmological Data 

In order to demonstrate the practicalities of interchang- 
ing multi-dimensional data, we consider the case of 
cosmological visualization: representation of the three- 
dimensional spatial structure of the Universe, includ- 
ing both observational and simulation datasets. Where 
such information exists, we extend this definition to in- 
clude time-evolving datasets (e.g. evolution of struc- 
ture formation or the hierarchical merging of galax- 
ies), and derived data products such as catalogues and 
merger trees. A modern, fully-digital cosmological vi- 
sualization allows the user to rotate, zoom, pan and 
even interactively select from datasets. 

3.1 Sources of Data 

Observational cosmological datasets are usually ob- 
tained from galaxy redshift surveys whereby 2-d sky 
positions (RA, Dec.) are combined with redshift (z) 
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Figure 2: A cone or wedge diagram is the standard 
representation for galaxy positions from a redshift 
survey, usually projected along the line of the ce- 
lestial p oles. The data is from the 6dF Galaxy 
Survey (jjones et al. 1 l200,1 ). 49 377 galaxy posi- 
tions, with < z; < 15 000 km s'^ and Dec. < 0°, 
are shown as black points in this projected view. 
Declination lines are drawn at intervals of 15°. 

to give a 3-d spatial location. The most common rep- 
resentation is the cone or wedge diagram, as shown in 
Figure [5] using galaxy positions fro m the 6dF Galaxy 
Redshift Survey second data release (jJones et al. 
An interactive 3-d visualization is advantagous in this 
case, so that the wedge can be rotated and zoomed. 
Without interactivity, it is difficult to interpret the 
details of the large-scale structure from a single view- 
point. This conveniently highlights the limitations of 
a static, 2-d publishing and presentation medium for 
n-dimensional scientific data! 

Cosmological simulations generally use A'^-body tech- 
niques to efficiently calculate the gravitational forces 
between an ensemble of dark matter, gas and star 
"particles". Each particle often comes with full infor- 
mation on mass, spatial position {x,y,z) and velocity 
{vx,Vy,Vz) over a range of time steps (or snapshots). 
Derived properties include energy (kinetic and poten- 
tial), temperature and density, which may be calcu- 
lated on a per particle basis or on a grid. Dubinski 
(2008) provides examples of standard technqiues for 
representing N-body data, but with an emphasis on 
pre-rendered sequences rather than real-time interac- 
tivity. 

3.2 Visualization Requirements 

There are four main data types that a cosmological 
visualization may need to represent: 

1. 3-d points: (RA, Dec, z) triplets for redshift 
surveys and {x,y,z) positions for A''-body simu- 



lations. 

2. 3-d vectors: {vx,Vy,Vz) velocity data from co- 
mological simulations, which have a spatial lo- 
cation and a direction, or fiow lines representing 
the motion of particles over time; 

3. 2-d and 3-d mesh-based data: density, tempera- 
ture, etc. suitable for display as pixel-based im- 
ages (2-d) or with volume rendering (3-d). Vol- 
ume rendering (Drebin, Carpenter & Hanrahan 
1988) combines gridded data with lighting ef- 
fects to give a virtual solid. Volume rendering 
requires an opacity to be defined for each vol- 
ume element (voxel). In general, this is a com- 
bination of absorption and emission, however, 
for cosmological datasets we usually only deal 
with emission: A-body particles or galaxies are 
either present or they are not. 

4. non-mesh data: a practical example is the iso- 
density surface, the 3-d analogue of a contour 
line in 2-d. These may make use of gridded data 
as a calculation aid, but are not constrained to 
align with the mesh. 

The treatment of the first three-dimensions is us- 
ally achieved through a direct mapping of (x, y, z) posi- 
tions to screen coordinates for viewing on a 2-d screen 
or with a 3-d stereoscopic display. Higher data di- 
mensions are visualized through a combination of tech- 
niques including: 

• colour, whether plotting points or mesh data, 
an appropriate colour map can help to highlight 
significant features in a dataset. Used carelessly, 
though, colour is also the best wa y to ruin the 
effect iveness of a visualization (e.g. iTufte IIT99GI . 

Emll); 

• point sizes: are most suitable when there is 
a natural size-ordering (e.g. mass, magnitude), 
rather than for a morphological or descriptive 
quantity (e.g. galaxy type, survey date). The 
latter are often better distinguished through the 
use of symbols or glyphs; 

• splats: are texture billboards, often with a 
gaussian profile, which can be used as an alter- 
native to volume rendering, particul arly when 
there are a large number of particles (jWestover I 

Il989l . Il990l ). Splats can demonstrate physical 
scales by choosing an approprate texture size. 
For a n example from cosmology, see ()Hopf fc Ertl I 

l2003f ): and 

• animation: usually reserved for visualizing vari- 
ation with time, although it can also show the 
variation of a quantity, such as cycling through 
a sequence of density isosurfaces. 

s2plot provides support for each of the data types 
and techniques described above, and so is appropriate 
for generating a range of cosmological visualizations. 
To provide the requirements of interchange, a move to 
other output formats requires that all of these data 
types are supported. Using examples from cosmolog- 
ical visualization, we now demonstrate how this has 
been achieved. 
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Figure 3: Oblique view of the 6dF Galaxy Redshift Survey (49 377 galaxies with < v < 15 000 km s^^ 
and Dec. < 0°). Density isosurfaces are overlaid on the galaxy locations, to help highlight the filamentary 
large-scale structure. Declination lines are shown at intervals of 15°. 



4 Cosmological Examples 

In this section, we present several specific examples 
from cosmological visualization. We look at how our 
approach permits interchange between s2plot desk- 
top applications, s2slides presentations and s2web. 
For 3-d PDF demonstrations of interactive volume ren- 
dering of a dark matter halo and a wedge diagram 
based on the CfA2 redshift survey, wc refer the reader 
to Figure 5 of Barnes & Fluke (2008) and Figure 6 of 
iFluke fc Barnes I (|2008f ) respectively. 

4.1 Wedge Diagram 

As discussed in the previous section, the wedge di- 
agram is the most common representation of galaxy 
locations from redshift surveys. Therefore, it serves as 
an important first demonstration of our approach to 
interchange. 

A static view of the 6dF Galaxy Survey (0 < f < 
15 000 km s"'^, Dec. < 0), projected along the celes- 
tial poles, was shown in Figure [J] An oblique view of 
the same dataset is shown in Figure [S] obtained as a 
screenshot from an interactive s2plot desktop appli- 
cation. The figure shows density isosurfaces overlaid 
on the galaxy locations to help highlight the large-scale 



filamentary structures. The isosurfaces were gener- 
ated by smoothing galaxy locations onto an 80'^-cell 
cubic mesh using the triangular-shaped cloud algo- 
rithm (TSC; Hockney & Eastwood 1988). The number 
count, Tiijk, in each cell is rescaled as log]^Q(l -|- riijk), 
and then linearly normalized to lie in the range 0-100. 
The final 3-d mesh is converted to an isosurface using 
the s2plot ns2cis() function, and displayed with the 
ns2dis() function. Both 25% (red) and 75% (yellow) 
contour levels are shown. No attempt has been made 
to correct for the non-uniform volume filling effect of 
the spherical (RA, Dec, z) coordinate system when 
smoothed onto a Cartesian grid in (s, j/, z)-space. 

The VRML output is saved into a file from the 
s2plot program when the user presses the key combi- 
nation Shift-W. The conversion to X3D format is syn- 
tactic only, and we use the freely-available "Vrml97toX3dNist' 
converter provided by the National Institute of Stan- 
dards and Technology^ Textures are written by s2plot 
in TGA format and must be converted to PNG for- 
mat: we use the ImageMagick convert programQ 
The resultant X3D file and PNG texture file(s) are 
then zipped together into one file. This file can be 



•^http : //ovrt .nist . go v/v2_x3d ■ htmll 
"^ihttp : //www . Imagemaglck ■ org/] 
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Figure 4: Dark matter halo merger tree from the Millennium Simulation. Progenitor halo positions are 
mapped to {x, y, z) coordinates in 3-d space, colour represents the redshift at which each progenitor is 
bound to the final halo ("heat": red = high redshift, white = low redshift), texture splat size is scaled by 
virial radius of each sub-halo. 











f 





Figure 5: Three steps in a merger between two equal-sized galaxies. The Gadget-2 simulation comprises 
60 000 particles that are smoothed onto a lOO'^-cell cubic grid using the TSC algorithm. The counts in 
each cell, n^fe, are scaled by log]^Q(l -I- Uijk) and then normalized to lie in the range 0-100. (top row) 
Density isosurface levels of 20% (red) and 65% (yellow), (bottom row) Volume rendering with a linear 
"rainbow" (blue-green-yellow-red from low to high density) colour-map. 
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placed on the Web and an existing s2web Flash pro- 
gram pointed to the zip file, or the zip file can be em- 
bedded in the Flash program itself. For this paper, we 
do the latter. 

The S2WEB version of the 6dF Galaxy Survey can 
be viewed at http : //astronomy. swin.edu. au/ s2plot/ interchange/6dF 
Mouse control of camera orientation, and key presses 
for functionality such as zooming, toggling autospin, 
and changing the spin speed are consistent between the 
Web and desktop applications. This is a critical part 
of our interchange philosophy - that there is a com- 
mon user interaction experience. Of additional inter- 
est here is the use of textured billboards for the RA la- 
bels, which retain their orientation towards the viewer 
regardless of the camera orientation. Line thickness, 
such as for the grid, is only a global setting in VRML, 
and correspondingly X3D. Therefore s2plot programs 
with S2WEB (or PDF) as a target should not use thick 
lines. A work-around is to use thin cylinders instead 
of lines. 



and s2wEB code correctly shades the textures. Typ- 
ically, coloured billboards are very small occupying a 
few tens of pixels, and so the penalty in total zip file 
size for this approach is small. We intend to build this 
capability directly into the s2web code shortly. 



4.3 Galaxy Merger 



4.2 Merger Tree 



Investigating the dynamics of mergers between galax- 
ies through numerical simulations has become critical 
to understanding how galaxies evolve over ©(Gyr). In- 
teractive viewing of the galaxy merger shows the differ- 
ent ways that such a system might be seen on the sky. 
By varying view angle and merger parameters, such 
as relative masses of the galaxies or distance of closest 
approach, the goal is to reproduce known merging sys- 
tems (such as the Antenna galaxies NGC 4038/9, 90 
million light years distant in the constellation Corvus, 
or the more distant merging pair NGG 2207 and IC 
2163 in Canis Major) and hence gain insight into their 
dynamical evolution. 

We use here a sample case distributed with the 



GadK et-2 gravity plus smo o th-particle hyd rodynamics 
Semi - analytic models o f galaxv formati^on (IWhite fc Frenki code ijSpringel et al. Il200ll : ISoringel I l200l). This test 
119911 : ICole et al. Il2000l : rCroton et al. II2006I ) makeuse 



of halo merger trees, usually generated from dark mat- 
ter cosmological simulations. Starting with a catalogue 
of halos at z; = 0, the halo constituents are traced back- 
wards in time within the simulation, so that the his- 
tory of mergers can be reconstructed. Each progenitor 
halo can then be tagged with a galaxy, and used as an 
input to a (prescriptive) galaxy formation model. In 
this ex ample, we use data fr om the Millennium Simu- 
lation ([S pringel et al. 11 20051) and the galaxy model of 
iDe Lucia fc Blaizot I (|2007D 

The s2plot application reads a text file generated 
by an SQL query of the Virgo - Millennium Database^ 
returning the list of progenitors for a given halo. The 
application is able to plot any combination of three 
(numerical) parameters in the 3-d space, and then ap- 
plies a colour map based on the fourth parameter. In 
Figure 13 we show {x,y,z) spatial coordinates for the 
progenitor halos, and colour by the redshift at which 
each progenitor is bound to the final halo ( "heat" colour 
map: red = high redshift, white = low redshift). Rather 
than using points to mark each progenitor, we use tex- 
tured splats, with sizes scaled by the virial radius of 
each sub-halo. 

Export to VRML and conversion to Web format is 
the same as for the 6dF case, and the s2web version is 
available from http : //astronomy . swin . edu . au/s2plot/int«f gfiaSJp?t¥«:« and the level of detail displayed. As 

the s2wEB versions use a 60^-cell mesh 



case simulates a merger between two equal-mass spiral 
galaxies, using 30 000 particles per galaxy. An s2plot 
application has been developed to enable interactive 
visualization of the merger, including using isosurface 
(Figure [S] top row) and volume rendering (Figure O 
bottom row) techniques to help highlight and identify 
specific features. The application can read multiple 
Gadget-2 datafiles, cycling between the series of steps 
in the merger - three representive stages in the merger 
are shown. As with the 6dF wedge diagram, isosur- 
faces are built by smoothing particle positions (in this 
case, onto a lOO'^-cell cubic mesh), and the number 
counts are log-normalized. Density isosurface levels 
of 20% (red) and 65% (yellow) are shown. A lower 
resolution mesh (80'') was used for the volume render- 
ing, and a "rainbow" colour map (blue-green-yellow- 
red from low to high density) is applied over the data 
range. 

Parameters for the visualization were adjusted within 
the s2plot program, and the isosurface model was ex- 
ported to VRML and converted to X3D. Since Paper- 
Vision3D is a software-only renderer (i.e. not hardware 
accelerated), it is not currently feasible to export the 
full resolution geometry for either isosurfaces or vol- 
ume rendering. Instead, there is a trade-off between 
download speed (due to file size of the geometry), the 



In this example, some additional steps are required 
to generate the appropriate texture splats. Within 
s2plot, a single texture image is used, and the colour 
is controlled within the software. A current limitation 
in Papervision3D's material attributes for rendering is 
that only the first colour applied to the texture will 
be used. Accordingly, we post-process the VRML file 
prior to conversion to X3D, and where a single texture 
is used more than once in different colours, we create 
multiple copies of the texture so that Papervision3D 



a compromise, 
for the isosurface calculation and a 40^-cell mesh for 
the volume rendering. 

An example of using isosurfaces to display a galaxy 



' ^http : //www . g-vo ■ org/Millemiium| 



merger is available at http : //astronomy . swin. edu. au/s2plot/interch 

For this example, we have pre-loaded 5 Gadget-2 snap- 
shots. Within the s2plot code, these are given unique 
FRAME* number identifications for the VRML output - 
s2web determines which of the frames should be dis- 
played, and the user can step through the sequence by 
pressing the spacebar. 

A particular application of implicit user-control of 
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Figure 6: Displaying the interactive view of a 
Gadget-2 galaxy merger via the s2slides ap- 
plication for use in an academic presentation. 
The s2plot desktop application is overlaid by 
S2SLIDES on top of a background image. The back- 
ground image can be created by any image or pre- 
sentation editor; in this case Microsoft PowerPoint 
was used, and the image was exported as a TGA- 
format file. 
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Figure 7: Embedding an interactive merger tree 
visualization in a COSMOS encyclopedia entry. A 
rainbow colour map is used to indicate progenitor 
redshifts (red = earliest, blue = latest), and there 
is no scaling of splat sizes. 



the s2plot model tree is found in axial-slice volume 
rendering: a 3-d gridded dataset is used to generate 
three sets of tex tures, one set along each l attice axis of 
the volume (e.g. iLacroute fc Levov I[l994l ). Each set is 
contained within its own branch of the model tree (us- 
ing the predehned VRSET* strings with the pushVRMLname 
function) and then Adobe 3D JavaScript (for PDF) or 
Adobe ActionScript 3 (for Flash) code is written which 
selects the best slice set to draw for the current camera 
location and view direction. The Flash application can 
be viewed at: http : / / astronomy . swin . edu . au/ s2plot/ int 

Figure |6] shows an example of an s2slides presen- 
tation using the galaxy interaction visualization ap- 
plication. The same s2plot code that is used in the 
desktop application is executed as a child process by 
S2SLIDES. The position of the application window on 
the background slide is customisable, and a fullscreen 
mode is available via a keystroke. 

While Microsoft PowerPoint and Apple Keynote 
do permit the use of embedded interactive datasets 
on slides through a VRML plug-in, they only provide 
a limited interaction capability, and do not support 
advanced displays. One of the main advantages of 
S2SLIDES is that, as an s2plot application itself, it 
can be used with advanced displays. This reusabil- 
ity means that a presentation can be given in 2-d via 
a laptop, but if a stereoscopic display is available, the 
presentation can be given in stereo simply by changing 
an environment variable for the display type. 

Some s2plot programs may load large data when 
they run. In order to alert the presenter and audience 
that something is happening, we utilize a spinning logo 
while applications are starting up. 



5 Future Work 

We have completed most of the work involved in writ- 
ing the s2plot model tree structure to VRML 2.0 
format, and we have demonstrated most of the capa- 
bilities required for the implementation of a common 
user interface across desktop, e-print (PDF) and Web 
(Flash) targets. The latest version of s2plot (2.4, 
October 2008) can export nearly all of the s2plot 
primitives to VRML, including transparent facets, bill- 
boards and interactive handles. 

A binary distribution of the s2web Flash appli- 
rntiori ?.n^_ ?_ template HTML file is provided on the 
?5?^W^w^iSite. We plan to release the source code for 
the s2wEB Flash application in December 2008. We 
will include the code that supports interactive handles 
using the HANDLE* naming convention in the VRML 
file; provide animation capabilities using the FRAME* 
naming convention; and support axial-slice volume ren- 
dering using the VRSET* naming convention. Users will 
be able to build the standard s2web application using 
the free Adobe Flex 3 SDK, or make simple modifica- 
tions to the code for custom animation and interaction. 
The combination of the s2plot programming library 
and the s2web Flash application yields a free and 
straightforward technique for astronomers and other 
scientists to generate 3-d visualizations on the desktop 
and transfer them to the Web. 

The prospects for future development of the in- 
tegrated s2plot solution for 3-d analysis, collabora- 
tion, publication, education and outreach are excel- 
lent. Specific areas for improvement and development 
are summarized below. 

• Based on Papervision3D and Flash Player 9, s2web 
is not hardware accelerated. Accordingly, its 
rendering speed, or equivalently frame rate, de- 
pends on both the size of the Flash window within 
the Web browser, and the complexity of the 3-d 
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geometry being displayed. Volume rendering of 
data sets larger than around 32^ pixels, splat- 
ting of more than a few thousand billboards, 
and the display of complex transparent isosur- 
faces, can become slow. However, Adobe Flash 
Player 10 now offers 3-d graphics accelerated by 
hardware and is presently in beta release. It 
is likely that Papervision3D will be modified to 
provide hardware accelerated rendering, thereby 
improving the usability of s2web without fur- 
ther work from us. While we wait for this up- 
grade though, we intend to assess the merits 
of re-writing s2web directly for the Flash 10 
Player, without using the PapervisionSD classes. 

Stereoscopic support: our s2plot philosophy 
has been to support multiple, advanced display 
devices from a single library code base. It should 
be reasonably straightforward to generate real- 
time, stereoscopic 3-d figures within Web browsers, 
by interleaving the left and right eye views when 
a suitable desktop stereo display is available; and 

Integration of Web-deployed 3-d assets with our 
in-house Content Management System (CMS) 
to enable straightforward inclusion of 3-d figures 
and diagrams in Swinburne Astronomy Onlin43 
course material and the COSMOS Encyclope- 
dia of Astronomyd For example, the COSMOS 
entry on hierarchical merging (Figure [T} con- 
tains a version of the interactive halo merger 
tree as described in Section r4.2l With regards to 
learning and teaching benefits, interactive pre- 
sentation and exploration of scientific data pro- 
motes student-centred active learning. There is 
a natural opportunity to provide the required 
interactivity via 3-d enabled Web sites, includ- 
ing presentation of conceptual models, geometri- 
cal models, and datasets from both observation 
and numerical simulation. Interactive applica- 
tions can be enhanced through features such as 
dynamics, selection, feedback, etc., all of which 
are feasible with our Flash/ ActionScript 3 ap- 
proach. 

Our 3-d PDF solution requires commercial soft- 
ware, specifically Adobe Acrobat 3D or Adobe 
Acrobat 9 Pro Extended. We are cogniscent of 
the risks of building upon proprietary (and often 
expensive) software products, however there are 
few alternatives at this stage: 

1. We have examined the Universal 3D (U3D) 
File Format If we could write suitable 
U3D files, then these could be embedded 
in PDF files as 3-d annotations using the 
excellent movielS I^T]eX style created by 
Alexander Grahn. Unfortunately there is 
no good reference implementation of the 
U3D standard, and its originators appear 
to have lost interest in maintaining or even 



"SAO: http : //astro nomy . swln. edu. au/sao I 

^COSMOS: http: //astronomy . swin. edu. au/cosmos/' 

^Standard ECMA-363 Universal 3D File Format: 



using the U3D format. Furthermore, we 
have been unable to preserve important vi- 
sualization attributes (such as point colour) 
when experimenting with U3D files using 
the Adobe software products. 

The better format for storing 3-d models 
in PDF files is Adobe's PRC format. We 
are not aware of any reference implemen- 
tations of the PRC format, and the speci- 
fication has historically been very hard to 
locate. While we cannot write PRC for- 
mat directly from s2plot at this stage, it 
may be possible in the future if Adobe are 
forthcoming with an open specification of 
the file format. In the meantime, what is 
possible is to use an Adobe product once to 
import s2PLOT-generated VRML, save the 
resultant PDF file, and then extract the 
model data in PRC format using a tool like 
pdftk. Once the PRC data is extracted, 
it can be easily added to documents gen- 
erated with pdf latex using the aforemen- 
tioned movielS M^rpC package. 



6 Concluding Remarks 

We have described our s2PLOT-based system for creat- 
ing 3-d visualizations, and our extensions which use 
VRML as an interchange format to enable the de- 
ployment of almost identical 3-d visualizations across 
multiple targets: the desktop (s2plot application), 
the electronic article (3-d PDF), academic presenta- 
tion (via S2SLIDES; or alternatively and more portably, 
using 3-d PDF documents created with the beamer or 
prosper M^jX packages), and the mainstream Web 
(Flash s2wEB application). The two key standards 
that our system builds on are the formal 3-d model in- 
terchange format (VRML and X3D) and the informal 
user interface: common camera and rendering controls 
across all output targets. 

We have used cosmological visualization as a spe- 
cific example of the requirements and benefits of inter- 
change between different target modes. s2plot pro- 
vides the basic set of graphics primitives necessary to 
represent wedge diagrams from galaxy redshift sur- 
veys and large-scale structure from cosmological simu- 
lations. Advanced functionality is also available, such 
as volume rendering, splatting and isosurfaces. We 
have demonstrated how cosmological visualization ap- 
plications built on these graphic capablities may be in- 
terchanged and accessed interactively at the desktop, 
on the Web, and during presentations. It is evident 
that this approach applies equally well across other 
fields of astronomy research. 

While a range of staiidard s-compliant (e.g. lWells. Greisen. fc Harten 
ll98ll : IOchse"nb ein et al. l2004l ) processing, analysis and 
visualization tools exist, astronomers tend to use their 
own data formats for intermediate steps of processing 
(particularly for theory and simulations). This avoid- 
ance of data standards makes interchange of data and 
intermediate results between collaborators a complex 



|http : //www ■ ecma- international ■ org/publications/standards/^Miiee^S .Itbids often only at the completion of a re- 
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search project that astronomers may chose to "pub- 
hsh" their data using an interchange format, and in- 
creasingly this includes Virtu al Observatory defined 
standards (jNorris et al. |[2"007t ). In most cases, it is 
easier to share still frames or animated sequences from 
data as intermediate products. 

Our approach provides a pathway for the sharing 
of intermediate and final data products in an interac- 
tive, 3-d format. The goal here is that interaction with 
the Web-based version should be as similar as possible 
to the application that was used to explore the data 
initially on the researcher's desktop. Using s2web, in- 
teractive models could be shared online for a "quick 
look" , in the same way that astronomers regularly put 
images on a personal or project Web site. 

A secondary benefit of interactive visualization in 
the presentation and publication modes is the addi- 
tional level of scrutiny available. Rather than select- 
ing a particular "best" view for a 2-d still image or 
animation sequence, the viewer is able to explore the 
dataset for themselves, either confirming or rejecting 
the conclusions as originally proposed. 

We believe that 3-d model interchange format (s) 
need to be augmented with a common user interface 
before reasonable uptake by the community, who have 
limited time to learn new tools and techniques, can 
be expected. The user interface includes interactive 
functionality such as the control of viewpoint that has 
never been required for classical 2-d graphics, but is 
axiomatic to 3-d visualization. By simplifying the de- 
ployment of interactive, 3-d visualization tools that 
share a common user interface across multiple media 
(desktop, e-print, presentation, Web), we aim to prop- 
erly enable and stimulate the strategic uptake of 3-d 
visualization techniques in astronomy. 
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